Touch screen control of video sources using preset configurations

ABSTRACT

The present invention is a video production and control system that uses a touch screen display and user interface, managed by a controller, for video source control. The system may include a set of touch screen windows that display feeds from sources of video information. For a selected feed window, the system displays a set of representations of preset configurations of the video source, which might be a camera, a video recorder, a handheld device, a storage device, a computer, or other source of video data. The representations may be thumbnail images of a view through the video source when it has the corresponding configuration. Selecting a different thumbnail using the touch screen will cause a controller to send control data through an output port that directs the video source to assume the newly chosen preset configuration. Some combination of controls in the touch screen user interface and control panel allow a user to manually reconfigure a video source, and optionally create a new corresponding preset thumbnail.

CROSS-REFERENCES TO RELATED APPLICATIONS

This application claims the benefit of U.S. Provisional Applications,Ser. Nos. 61/437,865, 61/437,890, and 61/437,882, filed Jan. 31, 2011,and Ser. No. 61/441,103, filed Feb. 9, 2011, each hereby incorporated byreference. This application is related to U.S. patent application Ser.No. ______, entitled “Touch Screen Video Switching System”, filed Feb.15, 2011, and hereby incorporated by reference. This application is alsorelated to U.S. patent application Ser. No. ______, entitled “TouchScreen Video Production and Control System”, filed Feb. 15, 2011, andhereby incorporated by reference. This application is also related toU.S. application Ser. No. 11/527,120, entitled “Presentation VideoControl System”, filed Sep. 9, 2006, and hereby incorporated byreference.

FIELD OF THE INVENTION

The present invention relates to production of video output from videosources. More specifically, it relates to a system and method for touchscreen video source control.

SUMMARY OF THE INVENTION

Video source control includes changing the configuration or parametersettings of a video source, such as a camera. For example, a set ofremote control cameras might be installed in a conference room totelevise the meetings of a government body. A given camera might firstfocus on the face of a speaker at a podium, then move to a whiteboardpresentation, and then track the speaker through the room. For a camera,configuration parameters include, for example, pan, tilt, zoom (PTZ),and focus settings; color model; and white balance. A camera may bephysical or virtual. A virtual camera's view might be computed fromviews of physical or other virtual cameras, or it might be an entirelycomputed view of a virtual environment.

The concept of video source control is quite broad, and includes, forexample, selecting particular slides from a business presentation on alaptop computer, switching a browser view to a different URL on theInternet, or updating the firmware on a physical camera. Video sourcecontrol might also include querying the source for information, such asregarding its state (e.g., send your model and serial number), policies(send your hours of operation), or environmental conditions (send thetemperature in the meeting room).

Video source control (and, in particular, camera control) is done by acontroller, which may respond to instructions from, for example, aperson or a computer. A touch screen surface may be coupled to acontroller to display the input feed from a video source, which has somecurrent configuration, and to provide a user interface, whereby a usercan send control data to the video source. The control data mightinclude instructions, parameters, or requests for information. Forexample, the command might cause a camera to focus on a whiteboard withspecified PTZ settings. The view from that camera displayed on the touchscreen will change as a result of the command.

A touch screen is a device that can be used to present video informationwhile monitoring user interaction with an interface of controls of thescreen surface. When a typical touch screen senses a touch, it sends anevent that includes the touch location to a controller. The controllercan then interpret that event as a user request for some action. A touchscreen can be integrated, for example, with a computer monitor, atelevision monitor, a tablet device, a handheld electronic device, or amonitor that is built into some kind of control system.

A sequence of touch screen events, possibly in addition to some locationdata, can itself be regarded as a touch screen event. A request from theuser to perform a certain task may require several touches of touchscreen controls, as well as entry of data. We will treat the term “touchscreen event” as comprising the set of events required for thecontroller to recognize it has a task to perform, and to execute thattask. Therefore, a touch screen event may involve multiple simultaneoustouches of the screen, and some rather complex motions, such as multipletaps, a finger stroke, spreading or narrowing the distance between apair of fingers, rotating a pair that are in contact with the surface,or combinations of any of these. A touch screen event may take intoaccount other physical parameters of a touch interaction, such as speed,distance, and rotation rate. Responsibility for interpreting suchcombinations or sequences as individual events may be the responsibilityof the touch screen, the controller, or some combination of the two.

In embodiments that include video source control, the touch screen maydisplay a plurality of thumbnail images for a given video source, eachthumbnail indicating a particular preset configuration. Preferably, thethumbnail will be an image captured from that source when the source hasthe corresponding configuration. For a given source, there may be anynumber of thumbnails, limited primarily only by the geometry of thescreen. For a given video source, touching a particular thumbnail is anexample of a user input that might cause the controller to send controldata associated with the preset configuration through a controlcommunication channel. The video source, upon receiving these data, mayassume the preset configuration, correspondingly altering the video feedfor that source that is being displayed on the touch screen.

The video production and control system may also facilitate the changingof the configuration associated with a given preset. Touching acurrently selected thumbnail, or some other user touch activity, mightenable controls that enable a user to modify the configuration. Thesecontrols might be touch controls on the touch screen itself, possibly ina separate graphical user interface (GUI) on the touch screen; directlyon a window showing a video feed from that source; or they could betactile physical controls (e.g., buttons, dials, levers, joysticks) on aseparate control panel. Such controls might, of course, be redundant ofthe touch screen controls, with some elements of control being providedby more than one of these user interfaces (UIs). The system might alsoallow reconfiguration of a video source without creating or modifyingany preset.

Note that a “video feed” can refer to a physical video feed or a logicalvideo feed. A physical video feed has a given format, including aresolution, a frame rate, a size, an aspect ratio, a color model, and soforth. As a signal moves through the video production and controlsystem, it may undergo a number of physical transformations, whilemaintaining the same logical content. A logical video feed representswhat a camera or other source is capturing at a given time, independentof the format that signal is being represented, but inclusive of theconfiguration of the source/camera. In other words, the logical videofeed is the content of the video, possibly motion video, as beingcaptured by the source. Throughout this document, when we refer to avideo feed, we ordinarily mean a logical feed. When a physical feed orsignal is intended will be clear from the context.

The touch screen may display feeds from several different video sourceseach, for example, in a separate window. A user command may be given tothe controller through the touch screen to cause it to select one of thevideo sources. A user command may cause the controller to display thepreset thumbnails for that video source. For example, touching a givenvideo source window might both select that source and cause thecorresponding set of thumbnails to display, with the currently selectedpreset indicated or emphasized.

Video feeds input to a system, may be communicated as system outputs.For example, a system with video source control may take input feedsfrom six remotely controlled cameras. A technician can use the videosource control functionality of the system to manipulate the content ofthe set of feeds during a video production by changing the viewconfiguration of some or all of the cameras in order to follow liveaction as it evolves. Up to six feeds could be output by such a system.Those outputs might then be used as inputs to a video switching system,such as the touch screen video switching system described below.

Switching from one video feed to another, from among several input videofeeds, to produce a Program output, is the task of a video switcher.Video switching is a separate and distinct concept from video sourcecontrol, but, as will be described below, the two can be synergisticallycombined together in a single touch screen video production and controlsystem. As an example of video switching, consider the broadcasting of abaseball game, in which several cameras are used. Separate cameras mightbe used, for example, to focus on the pitcher, the batter, the ball, thescoreboard, and the fans. The feeds from each of these cameras might bedisplayed in a window on a touch screen. At any given time, aside fromvarious insets and composites, one of the video feeds, the Program feed(also known as the “main” or “hot” feed), is the primary Program outputbroadcast to viewers. The Program output is “consumed” by everyonedownstream of the system, including, for example, a television networkand its home viewers.

Customarily in the industry, at any given moment in a video production,a video input feed other than the Program feed is designated as Preview.Ordinarily, the Preview feed is selected by a producer or technicianwith the idea that the Preview feed will at some future time become thenext Program feed. So, at any given moment, there is a set of incomingvideo feeds, one of which is selected as Program feed, and another asPreview feed. Any one of the video feeds that are currently neitherPreview nor Program might be selected as the next Preview feed.

A touch screen, in conjunction with a controller, can be used toimplement video switching in a video production and control system. Thevarious input feeds might be displayed, each in a separate window on thetouch screen.

Through the touch screen user interface, a user may be able to specifyto the controller the number of various windows and controls, and theirlayouts on the touch screen. The controller will store thisconfiguration information, and use to interpret user touches ascommands. In other embodiments, the number of windows and/or theirlayouts may be fixed, or perhaps limited by some constraint on themaximum number of input feed connections.

By touching appropriate controls, a user can specify a transition mode,transition a Preview feed into the Program feed, or promote a feed intothe Preview feed. For example, a might display two rows of windows and aGUI. The GUI could have a number of touch controls, such as buttons,scrollbars, text windows, and menus. The top row of windows mightdisplay the current Program and Preview feeds. Another row of windowsmight show all feeds (or optionally, all feeds except Program andPreview). Any of the windows might have textual or iconic labelssupplied by a user through the UIs. Touching a window displaying theProgram feed might swap the Preview and Program feeds. Alternatively,pressing a touch screen button labeled “Take” might cause Program andPreview to be swapped. Touching any window in the all feeds row mightcause that window to be highlighted or otherwise indicated as selected.Then touching the Preview feed moves whichever video feed is currentlyselected into the Preview window. In some embodiments, touching thePreview window may initiate the swap. Touching a feed window may promotethat feed to Preview.

When a new feed is selected to be the Program feed, that feed will beoutput through the Program output communication system, for example,through a communication port. One reason for having a Preview selectionand a Preview window is to facilitate smooth transitions from Preview toProgram output. GUI buttons on the touch screen might provide variousoptions for how transitions are done. Choices could include, forexample, cut, fade, crossfade, and/or wipe. There might be a globaldefault type of transition, such as crossfade, but the user might beable to handle a particular transition by another technique. Through theUI of the touch screen, the user might also be able to specifyparameters of the transition, such as timing or speed.

Video source control and video switching can be combined into a singletouch screen system. To illustrate this, consider the example layoutdiscussed above in which a video switching system has a top row ofwindows displaying Program and Preview feeds, and a second row ofwindows displaying the content of all video input feeds. A bottom, thirdrow of windows might be included that shows preset thumbnails for thecurrently selected window of the middle, all-feeds, row. While a givenfeed window is selected, camera control functions, including changing toa different preset configuration or creating a new preset configuration,are possible. Video switching could operate with the touch sequencesalready described. For example, press crossfade to set a transitiontype. Press the Program window to swap the Preview and Program feedsaccording to a user-specified transition mode. Press the Preview windowto promote the currently selected window from the all-feeds row toPreview. Of course, many other touch screen configurations and commandsequences are possible within the scope of the invention.

Again, it should be mentioned that a given feed signal may undergo anumber of transformations as it moves through the system.Standardization is an important consideration. Signals may bestandardized at various stages for bit depth, color model, frequency,synchronization, size, aspect ratio, and other factors. Additionaltransformations may be performed on any feeds that are output from thesystem. In the case of a system providing only video source control, allor some subset of the input feeds may be output. For a system providingvideo switching, the Program feed will be output for consumers.

A control panel with conventional tactile controls might be provided tosupplement the touch screen for control of camera configuration and/orcontrol of video switching. The reasons for doing so include (1)redundancy in case of equipment failure; (2) better familiarity of asystem operator with some traditional controls than with their touchscreen counterparts; or (3) more accurate or efficient performance ofparticular tactile controls for some operations. For example, some usersfeel that precise manipulation of camera PTZ configuration is moreeasily achieved with a joystick than with touch screen controlworkalikes. Nevertheless, a touch screen alone can be configured tohandle all requirements to implement the UI of a system having videosource control and/or video switching. Such a touch screen might employany of the windowing and UI techniques known in the art.

This Summary section has been written to illustrate concepts of theinvention for the reader. As such, some simplifications have been madefor clarity that should not be taken to limit the scope of theinvention. Some embodiments of a “system” may end at its input ports,output ports, and user interface. For example, the system apparatus maybe regarded as including logic and hardware for receiving video feedsthrough its input ports, sending control information through controlports, sending video through output ports, and sensing touch and othercontrol events through its UIs. In such a case, the externalcommunication systems, the cameras and other video sources, the consumerof output video (which might, for example, be a video recorder or amonitor) and the users that interact with the apparatus are all regardedas being external to the “system”. In other embodiments, a systemapparatus might be regarded as including some or all of communicationsystems to video sources and video consumers; video sources; and videoconsumption equipment. The invention encompasses processes or methodsthat use the kinds of functionality that an apparatus as describedherein provides.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic drawing of a touch screen video production andcontrol system having video source control and video switching.

FIG. 2 is a schematic drawing illustrating the functionality of acontroller in a touch screen video production and control system havingvideo source control and video switching.

FIG. 3 is a flowchart illustrating one approach to using touch screenvideo source control to select a preset configuration of a video source.

FIG. 4 is a flowchart illustrating one approach to using touch screenvideo source control to select a preset presentation video slide from avideo source.

FIG. 5 is a flowchart illustrating one approach to using touch screenvideo source control to create a new preset configuration of a videosource.

FIG. 6 is a flowchart illustrating one approach to using touch screenvideo switching to select the Preview video feed from a set of inputvideo feeds.

FIG. 7 is a flowchart illustrating one approach to using touch screenvideo switching to promote and transition the Preview video feed to theProgram video feed.

FIG. 8 is a block diagram of controller components in a touch screenvideo production and control system.

FIG. 9 is a block diagram of a video control subsystem of the controllerin a touch screen video production and control system.

FIG. 10 is a table showing a scheme, alternative to FIG. 3-7, for touchcontrol of the video feeds in a touch screen video production andcontrol system.

FIG. 11 is a schematic drawing of a touch screen video production andcontrol system having video source control.

FIG. 12 is a schematic drawing illustrating the functionality of acontroller in a touch screen video production and control system havingvideo source control.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

This description provides embodiments of the invention intended asexemplary implementations. The reader of ordinary skill in the art willrealize that the invention has broader scope than the particularexamples described here.

Overview

A video production is a Program output typically constructed fromseveral video source inputs or feeds. A video production might cover anevent such as a public meeting of a government body, a sporting event, apresentation or lecture, a church service, an operatic performance, or amusic video production. In any of these contexts, several cameras mightbe used to capture content from various people or portions of the forumor setting. A production of a documentary about some political eventmight need to knit together segments of recorded video, segments inwhich the show host speaks, and segments in which various historiansdiscuss the context and consequences of the event. A lecture mightalternate between views of a presentation software slide deck, thelecturer speaking, the audience, a whiteboard, recorded video clips, andinformation displayed through a web browser. Transitioning among a setof input video feeds to produce a single program output is the processknown as “video switching”.

A camera, or other video source, might conceivably be configured onlyonce at the start of creating a production, or might need to bereconfigured several times, perhaps frequently, throughout the course ofthe production. Video source control, or camera control in particular,is the process of commanding a video source to assume a certainconfiguration.

Configuration of a given source might be done automatically, by acontroller. Configuration may also be done manually by a producer or atechnician. Automatic configuration of a source might be done, forexample, using tracking logic or triggers that follow the movements of alecturer. Manual configuration might be used, for example, to move avideo camera among different people in an audience, or to follow the“action” of a sports event. Manual configuration might be done remotely;that is, without direct contact by a user with controls on the cameraitself.

FIG. 1 is a schematic drawing of an embodiment of a touch screen videoproduction and control system 100 having both video source control andvideo switching. The system 100 includes a touch screen 110 having atouch screen display 112 integrated with touch screen UI 111. The touchscreen UI 111 may include a GUI 139. The video production and controlsystem 100 is managed by a controller 141, which in this particularembodiment is housed in a unit having a control panel 140 employingvarious tactile controls 142, such as traditional buttons 143, knobs146, switches, levers, and joysticks 144. We will use adopt the term“tactile controls” to distinguish these traditional physical controlsfrom touch screen UI 111 controls, despite the fact that touch screen UI111 controls are themselves “tactile”. The control panel 140 may alsohave various indicators such as LEDs 147, and a control panel display145.

The controller 141 can communicate with video sources 170 using variouscommunication technologies, devices, channels and pathways 160, 161, andcommunication system(s) 162. The controller 141 connects to suchcommunication channels by video source interfaces 150, which may or maynot be physical video source connectors 151. Communication from a givenvideo source 170 may include a video feed, and may include one-way ortwo-way control communication between the controller 141 and the videosource 170. In one-way control communication, the controller 141 sendscontrol data to the video source 170, possibly causing the video source170 to change its configuration. Two-way communication adds feedbackfrom the video source 170 through the control channel, possibly ofidentity, location, set-up information, status, event occurrence, orenvironmental conditions.

The video switching portion of the video production and control system100 produces Program video output 199, transmitted through a videoProgram output connection 152 (which may or may not be a Program outputconnector 153), then through a communication system 190 to a Programconsumer 191, which might be, for example, a broadcast system, arecording device, a closed circuit television system, an Internetstream, or simply a cable to a monitor. In FIG. 1, a broadcast tower 192is used to represent a typical Program consumer 191.

Video Sources Generally

The system 100 will have at least one video source interface 150communicably connectable with a video source 170. In a video productionand control system 100 with video source control only, there need beonly a single video source interface 150, although more typically therewill be more than one. In a video production and control system 100 withvideo switching, there will be at least two input feeds 131 to allowswitching. More typically a system will support four or more video feeds131. For example the system 100 illustrated in FIG. 9 has six. Inprinciple, there is no upper limit to the number of video sourceinterfaces 150 and feeds 131 for any touch screen video production andcontrol system 100. In practice, however, the number of video sourceinterfaces 150 may be limited in a particular system by the capacitiesof various elements, such as geometry of the touch screen 110, bandwidthof communication links, speed of a controller processor 200, or size ofa physical box housing a controller 141.

A video source 170 may be of any type, although typically two or more ofthe video source interfaces 150 will provide motion video, in the senseof a sequence of frames intended to depict motion, in a digital and/oranalog signal. A video feed 131 depicting motion might originate from avideo source 170 such as a video camera 171, a video playback device 172(e.g., a digital video recorder (DVR) or a video tape/cassette recorder(VTR/VCR)), or a handheld media device 173 (e.g., a media player or acell phone), a computer 174, or a storage device 175 (e.g., a flashdrive, hard drive, or solid state drive). A source 170 might be alocation addressable across a network, for example, a websiteaddressable by its URL.

A given video source interfaces 150 may provide one or more discretestatic files. Such a static file might include a document, or a singleimage or collection of images. Images might be provided sequentially ona pull basis; that is, upon request from the system 100 to the videosource 170. The ability to interleave motion video with still images isimportant in many video productions.

In FIG. 1, a box housing a controller 141 is depicted with four videosource interfaces 150. The video source interfaces 150 might use anymeans of wired or wireless connection to the outside world. For example,a touch screen video production and control system 100 might beinstalled to cover meetings of a class, a club, or a government body. Insuch a case, hardware video source connectors 151 might connect thesystem 100 to remote control cameras 171 by means of hard-wired cables(e.g., USB, RS-232, or HDMI). Such cameras 171 might provide digital oranalog signal, in a variety of formats (including timing, resolution,aspect ratio, and synchronization). The system 100 can be configured toaccommodate such variety through its choice of connectors and processingcomponents. A controller 141 box may provide slots for insertion ofcards, each card an interface to a communication system(s) 162. Thecards can have a wide variety of types. Preferably, a card will do thebulk of formatting required to standardize its input signal required,with the controller 141 specifying the standard format.

A given video production and control system 100 with video switchingmight or might not include video source control. If it does not, thenone or more of the video sources 170 input to the video production andcontrol system 100 might be the output of an external video sourcecontrol system.

Video Source Control

If the system 100 has video source control, at least one video sourceinterface 150 will allow the system 100 to receive a video input feedfrom, and to transmit control data to, a source 170. As will bedescribed later, for such a video source interface 150, the video feed131 input and the video source interfaces 150 may use the same, ordifferent, communication ports, technologies and/or pathways. The videosource interface 150 may, in other words, be implemented as a singleconnection, or may actually represent a plurality of physical and/orlogical connections. In summary, from the standpoint of the touch screenvideo production and control system 100, such a video source interface150 will support video in, control out, and possibly control in. Anexample of such a source 170 is a remotely controlled or robotic camera171, capable of being instructed to assume various configurations.Factors that might be configurable for a video camera 171 include PTZ;contrast; brightness; white balance; resolution; frequency; size;firmware; and potentially many more. A camera 171 might be configurableto enable or begin automatic tracking of a speaker; or the controller141 might receive a sequence of target locations from a tracking system,the controller 141 then sending corresponding reconfiguration commandsto the camera 171. For a business presentation, “configuration” might bea simple as selecting the next slide. The video source 170 might also beable respond to questions regarding its status, for example: (1) reportparameter state; (2) report model or serial number; (3) report softwareor firmware version or configuration; (4) report physical location; or(4) report environmental variables. Such status information might beused by the controller 141 to determine how and when to control thecamera 171, or might be used for other purposes, including modifying theuse of a video feed 131.

Another example of a video source interface 150 that might be used in asystem with video source control is a virtual camera, which depictsvideo derived from or calculated from the video content of one or morephysical or other virtual cameras. Even a computer 174 providing stillimages (e.g., JPEG files) might be controlled through its video sourceinterface 150 using, for example, a command to start a slide show, tomove to the next image, or to zoom in on some particular feature.

Some system configurations might incorporate the capability to compositetwo or more feeds into a single feed window or into the Program output(e.g. with a picture-in-picture video). In some configurations, acommentator or presenter might be able to add annotations to an inputfeed for output.

Communication System

In general, a given video source 170 may connect 161 to a communicationsystem(s) 162. This connection will at least one way (out from the videosource 170), and may be two way; it must be two way for video sourcecontrol of that device (although the two way communication mightactually use different means and follow different pathways). Ultimately,a video feed 131 arrives at a video source interface 150 of the touchscreen video production and control system 100. Data (includingcommands, instructions, and/or status queries) for video source controlmay flow in the opposite direction. Status or other information may betransmitted from source 170 back to the touch screen video productionand control system 100. Between the video source 170 and the touchscreen video production and control system 100 there may be anycommunication means, including, for example, wide area network, localarea network, personal area network, cables, connectors, electricalbuses, wireless communication. A given pathway between video source 170and the touch screen video production and control system 100 may usemore than one of these technologies. In FIG. 1, a cloud represents thecommunication system(s) 162 between various video sources 170 and thevideo production and control system 100.

Video Output Video Source Control System Output

A touch screen video production and control system 100 that includesvideo source control but not video switching will produce a set ofoutput videos that is a subset of the input feeds; that is, some or allof the input feeds. The video sources 170 producing these output feedsmay be configured once, or reconfigured using the capabilities of thesystem many times while in operation during creation of a production.The operator of such a system may have discretion in selecting how theconfigurations of the video sources 170 change over time, and/or inselecting which video feeds from the video sources 170 are output.

However, since video source control technology may be combined withvideo switching technology in a single video production and controlsystem 100, the video feeds originating from the configured andcontrolled video sources 170 may be immediately and directly used toprovide video segments assembled in the Program video output 199 by thevideo switching technology part of the system 100.

Video Switching Program Output

The touch screen video production and control system 100 with videoswitching technology produces a video output signal, called the Programvideo output 199, that is based upon one or more of the feeds 131 fromthe video sources 170. In its simplest form, the Program video output199 is created by switching from one input video feed 131 to another, inresponse to user commands received by the system 100 through its touchscreen UI 111, perhaps supplemented by a control panel user interface820. In FIG. 1, this is depicted as an arrow 190 from a video Programoutput connection 152 in the system 100 to some Program consumer 191.For emphasis in the figure, this is shown as a broadcast tower 192,although while the Program is being output through the video Programoutput connection 152, it can travel anywhere by means of anycommunication method, as described above in regard to communicationsystem(s) 162, or it can be recorded and stored. There may be multipleforms of the Program video output 199, each with its own video Programoutput connection 152. For example, the Program output may be in digital(in various formats) and/or analog (in various formats). The Programvideo output 199 might in some embodiments be output through a physicalProgram output connector 153.

User Interface

The touch screen video production and control system 100 will have a UI149 that includes touch screen UI 111, which has user touch controls toimplement its functionality, such functionality including either videosource control, video switching, or both. The UI 149 may also include acontrol panel 140 having tactile controls 142.

Touch Screen Interface

FIG. 1 illustrates a touch screen video production and control system100 having both video source control and video switching. Thisparticular illustrative embodiment includes three rows of windows,associated with video feeds 131, and a graphical user interface (GUI)139 area which includes various other touch controls whereby a user canmanipulate the system. Other touch screen UIs 111 may be configured orlaid out differently, either by the system 100 or by a user through thecontrol panel 140 or a GUI 139.

Each video feed window 130 in the middle row shows the content videofeed 131 from a respective video source 170. Typically, the content ofone or more of the feeds 131 will be changing and evolving as theproduction progresses, possibly in near real time. The bottom row showsa set of thumbnails 136, each thumbnail 136 representing a particularpreset configuration of a selected video source 170. The top row ofwindows includes a Preview window 122 and a Program window 120. Thecontents of the Program window 120 will be output simultaneously (atleast in terms of normal human perception) through the Program window120 and the video Program output connection 152. A video production andcontrol system 100 having only video source control capability mighthave a similar appearance, but might lack the windows appearing in thisparticular embodiment in the top row. One having only video sourcecontrol capability might lack the thumbnail 136 windows appearing in thebottom row.

Of course, many arrangements of the touch screen 110 controls anddisplays are possible to achieve equivalent functionality. For example,suppose that a set of cameras 171 is configured once and only once atthe start of a production. A system might provide a control to allowdisplay of the preset thumbnails 136 to be enabled or suppressed, or tochange the layout of the touch screen UI 111.

In FIG. 1, video feed windows 130 corresponding to feeds 131 from fourvideo sources 170 are shown numbered 1-4 and having reference numbers130 a-130 d, respectively. At the depicted moment in time, window #4 ismarked with a star, indicating that it is displaying the feed 131 thatis the current Program feed 121, which also appears in the Programwindow 120 above, and likewise marked with a star. Window #1, markedwith a triangle, is displaying the feed that is currently the Previewfeed 123; the Preview feed 123 is also being displayed in the Previewwindow 122, and likewise marked with a triangle. Window #3, marked witha diamond shape, is displaying a feed whose video source 170 has beenselected for configuration. The bottom row contains Preset windows 135,each displaying a thumbnail 136 image that shows a particular presetconfiguration 137 of that video source 170. Typically, a thumbnail 136will be an image captured with the video source 170 in the presetconfiguration 137 to which the thumbnail 136 corresponds. One of thethumbnails 136, namely #3B, is marked with a diamond, indicating that itis the currently selected preset 138 configuration of the video source170 whose feed 131 is displayed in window #3.

Note that the star, triangle, and diamond figures were used tofacilitate simple description of FIG. 1, and would be unlikely to appearin a real implementation of the touch screen UI 111 of a videoproduction and control system 100. A colored border around a window isone of many possible examples of a more realistic emphasis means forindicating selection of the item represented by that window.

The touch screen UI 111 can be used to modify the configuration of avideo source 170, either by changing that video source 170 to adifferent existing preset configuration 137, or by manual configuration,with or without creating a new preset configuration 137. For example, inFIG. 1, the video source 170 of window #4 is presently selected, and itis in the configuration displayed in the thumbnail 136 labeled #3Brepresenting the selected preset 138. A new configuration might beselected when the system 100 senses that an operator has touched one ofthe other preset thumbnails 136, say #3E. At that point, the system 100will send control data 263 to the video source 170 of window #3. Thedetailed instructions or data for configuring a video source 170 in aparticular way might be stored in the video source 170, or in thecontroller 141, or split between the two. For example, the controller141 might only need to send the video source 170 an index of a presetconfiguration that is stored in hardware or firmware, as instructions orparameters, on the video source 170. Selection of a different videosource 170 for configuration might be done, for example, by pressing thewindow in the middle row for that video source 170. Of course, manyother means of indicating selection are possible, such as making achoice within the GUI through a menu or a text box.

Manipulating a video source 170 into a new configuration might be done,for example, by first touching an already selected preset thumbnail 136,or by pressing a preset thumbnail 136 and holding it down for someminimum period, say four seconds. Once creation of a new presetconfiguration 137 is initiated, an operator might use touch controls inthe touch screen UI 111 or tactile controls of a control panel 140, suchas a joystick 144, to reconfigure the video source 170. In someembodiments or situations, a new configuration might be requested bysending a command in text form, or a sending set of program instructionsretrieved from storage. A new configuration might (or might not) bestored, and displayed in a preset thumbnail 136.

Control Panel

A control panel with conventional tactile controls 142 might be providedto supplement the touch screen 110 for control of video source 170configuration or control of video switching. The reasons for doing soinclude (1) redundancy in case of equipment failure; (2) familiarity ofsome system operators with some traditional controls; or (3) betterperformance of particular tactile controls for some operations. Forexample, some users feel that precise manipulation of camera PTZconfiguration is better achieved with a joystick 144 than with touchscreen control workalikes. Nevertheless, a touch screen 110 alone can beconfigured to handle all requirements to implement the UI of a system100 having video source control and/or video switching. Such a touchscreen UI 111 might employ any of the windowing and touch controltechniques known in the art.

The touch screen display 112 and touch screen UI 111, controller 141,video source interfaces 150 (for video feeds and, in some embodiments,for video source control), and video Program output connections 152,and, optionally, a control panel 140 form the core of a touch screenvideo production and control system 100. A dashed line 101 in FIG. 1distinguishes these core components from other components that,depending on embodiment, might be regarded as within the particularsystem 100 or external to it.

Controller Functionality

FIG. 2 is a schematic drawing illustrating the functionality of acontroller 141 in a touch screen video production and control systemhaving both video source control and video switching. The controller 141is some combination of software and hardware to execute the logic thatprovides the system 100 with various kinds of functionality. Thecontroller 141 may be housed, in whole or in part, within a structurethat also includes a control panel 140. Alternatively, the controller141, or portions thereof, might be included in a monitor whose surfaceis the touch screen 110. Ultimately, the controller 141 functionalitymust be housed in some kind(s) of hardware platform, but the division ofthat functionality among one or more hardware resources may vary amongembodiments of the invention. Typically, the controller 141 will behoused in either a control panel 140 unit or within whatever structurehouses the touch screen 110. Preferably, the controller 141 will behoused in a unit separate from the monitor (or other display device) andtouch screen 110 surface, to allow these components to be easily andinexpensively purchased off-the-shelf. Indeed, the controller 141 willpreferably allow itself to be configured through its UIs 149 or throughan external interface so the touch screen 110 display and touch screenUI 111 can work on a range of different types of display equipmentranging from monitors to touch pads to cell phones and portable mediaplayers, as well as various types of input connections/connectors. Ifvideo source control and video switching are in separate systems, theremay be two controller boxes, each possibly having a control panel 140.

The controller 141 interacts through interfaces with the environment,namely, with users, video sources 170, and Program consumers 191. Avideo source interface 150 may include a video feed connection 150 a anda video source control connection 150 b. The controller 141 receivesvideo feeds 131 from video sources 170 through respective video feedconnections 150 a. A video source 170 feeds video to the video feedconnection 150 a through communication system 260 a. If the system 100has video source control, the video source 170 may have two-waycommunication 260 b with a video source control connection 150 b. Thecommunication paths 260 a and 260 b may be the same or separate. Thevideo feed connection 150 a and the video source control connection 150b might likewise, for example, be implemented as a combined connector orseparate connectors. If the system does not have video source control,then the video source control connections 150 b might not be included. Avideo source control connection 150 b might itself have separate inputand output connections/connectors.

The controller 141 interacts with users of the touch screen 110 throughconnection 180 by both the touch screen display 112 and the touch screenUI 111 controls. The controller 141 arranges the layout of the touchscreen 110, and the content presented there, in some systems accordingto user specification. The content includes, for example, content typesdescribed in reference to the touch screen 110 illustrated by FIG. 1.The touch screen 110 sends touch interaction events that include touchlocation to the controller 141. The controller 141 determines how torespond to such events based on how the touch screen UI 111 is laid out.The controller 141 also interacts through communication channel 280 withusers of the control panel 140, if any, as described in connection withFIG. 1.

The controller 141 interacts with a Program consumer 191 though a videoProgram output connection 152 The video Program output connection 152might be implemented as a connector or in some other way, such as atransmitter.

Central to the controller 141 is a processor 200, which includeswhatever hardware and software are used by the controller 141 to executerequired logic and to coordinate the various components of the touchscreen video production and control system 100. The processor 200 mightinclude one or more microprocessors, logical gates, softwareinstructions, hardware storage, and so forth. The logic of thecontroller 141 is best defined by what it does. Three categories offunctionality, separated in FIG. 2 by dashed lines, are described below.

Any touch screen video production and control system 100 will have acontroller 141 that may have some or all of the following generalfunctions: manage 201 the video source interfaces 150; store/retrieve204 any data and code needed by the controller 141 to carry out itsfunctions; standardize 206 video feeds formats for touch screen display;lay out 202 the UI, potentially according to user specifications; build203 the screen images and display them as video; implement 208 the touchscreen UI 111, including responding to touch events; respond 205 totriggers or tracking information from external sources by automatically;and interact 207 with some external control system, for example toupdate software or firmware on the system 100, or to test the system.

The controller 141 of a touch screen video production and control system100 having touch screen video source control may have some or all of thefollowing functions: manage 223 the video source control connections 150b to the system 100; cause 220 a video source 170 to configure itselfaccording to a preset configuration 137; reconfigure 222 a video source170 using touch screen UI 111 controls; create and store 221 a newpreset configuration 137.

The controller 141 of a touch screen video production and control system100 having touch screen video switching may have some or all of thefollowing functions: select 231 the Program feed 121 and Preview feed123 from among the input feeds 131; manage 230 transitions from Previewfeed 123 into Program feed 121 according to the current user-selectedtransformation mode; and format 232 the Program feed 121 for Programvideo output 199 to Program consumers 191.

Selection of a Preset Configuration

FIG. 3 is a flowchart illustrating, in an embodiment of the invention,one possible implementation of the use of touch screen video sourcecontrol to select a preset configuration 137 of a video source 170. Inthis and the other flowcharts, text displayed in a hexagon depicts anassumed state of the system 100 prior to the start of the particularprocess.

In this flowchart, S_(v) is a video feed connection 150 a or port to avideo source 170 S. F is a window, as in the middle row of the touchscreen 110 of FIG. 1, displaying the video feed from video feedconnection 150 a. T₁ is a thumbnail 136 representation of presetconfiguration 137 C₁, and T₂ is a thumbnail 136 representation of presetconfiguration 137 C₂ of the feed 131.

At the start 310 of the process, video received through port S_(v) isbeing displayed 300 in video feed window F. The source S of the videofeed has an initial configuration of C₁.

A touch is sensed 320 of window F. In this embodiment, such a touchselects F, as well as the video source control connection 150 b thatcorresponds to F. Other methods of implementing such selection are, ofcourse, possible within the scope of the invention. Indeed, in otherinstances in this and other flowcharts, the practitioner of ordinaryskill in the art will recognize that there are other equivalent methodsto achieve the same effect, and for clarity we will dispense withfurther caveats of this kind in the flowcharts. FIG. 10 depicts one suchalternative scheme.

Window F is somehow highlighted 330 to indicate its selection. Inthumbnails 136, the preset configurations 137 corresponding to portS_(v) (and, in turn, to S) are displayed 340, for example, as in thebottom row on the touch screen 110 of FIG. 1. The thumbnail 136 T₁ forpreset configuration 137 C₁ is emphasized or highlighted 350 to indicatethat it is the currently selected preset configuration 137 being used byvideo source 170 S to display the video feed 131.

A touch is sensed 360 of thumbnail 136 T₂. The touch screen 110 firstsenses the event, which the controller 141 interprets, in thisembodiment, as a user request to change to the corresponding presetconfiguration 137 C₂. The controller 141 sends 370 a command (controldata 263), through the video source control connection 150 b S_(c)corresponding to S_(v), asking S to change its configuration to C₂. Thecontroller 141 causes the touch screen 110 to indicate 380 the thumbnail136 T₂ corresponding to C₂ as selected. Barring difficulty, S changesits configuration in response to the command sent through its videosource control connection 150 b, so now the system 100 displays 390video received through port S_(v) in window F with S now havingconfiguration C₂. The process ends 399.

Selection of a Business Presentation Software Slide

FIG. 3 is the kind of video source control that might be used with, forexample, a remote control camera 171. In contrast, FIG. 4 is a variationvideo source control, where the video feed consists of businesspresentation software slides in an embodiment of the invention.

At the start 410, video received through port S_(v) is being displayed400 in video feed window F, with source S showing a slide d₁. A touch issensed 420 by the controller 141 of window F. This touch causes F to beemphasized or highlighted 430 and thumbnails 136 of the slides fromvideo source S to be displayed 440, with T₁ showing slide d₁ beinghighlighted 450. A touch is now sensed 460 of thumbnail 136 T₂, whichdisplays slide d₂. Through control port S_(c), S is commanded 470 tochange to slide d₂. Selection of the new thumbnail 136 slide isindicated 480. Presumably, S changes its configuration in response tothe command sent through its video source control connection 150 b, sonow the system 100 displays 490 video received through port S_(v) inwindow F with S now having configuration C₂. The process ends 499.

Creation of a New Preset Configuration

FIG. 5 is a flowchart illustrating, in an embodiment of the invention,the use of touch screen video source control to create a new presetconfiguration 137 of a video source 170. At the start 510, initially 500the thumbnail 136 T showing the current preset configuration 137 C₁ forvideo source 170 S is emphasized. Window F is displaying a video feedreceived through port S_(v) from S. A user touch of thumbnail 136 T isthen sensed 520. The controller 141 could at this point enable usercontrols for configuration of S. In any case, some command is received530 through the UI for control of S. The controller 141 sends 540 acorresponding command through control port S_(c). (Logically it is thesame command, but physically the commands received by the controller andsent to through S_(c) are probably different in form and/or in content.)For example, the command might change a PTZ setting of a camera 171. Thecommand might cause S to send some feedback to the system 100 throughS_(c), which would then be displayed 550 for the user on the touchscreen 110. The video feed 131 from video source 170 continues to bedisplayed 560 in F, but now according to the new preset configuration137 resulting from the user command. If 570 the user has more commands,then the flow returns to step 530. Otherwise, a snapshot captured fromthe current input feed from S is stored 580, and is displayed 590 in thethumbnail 136 T. The process ends 599. Note that in some embodiments,reconfiguration of a video source 170 alone does not necessarily cause achange of preset configuration 137 and thumbnail 136; a change in presetconfiguration 137 requires a separate step. The scheme illustrated byFIG. 10 is of this type.

Selection of a New Feed as the Preview Feed

FIG. 6 is a flowchart illustrating, in an embodiment of the invention,the use of touch screen video switching to select the Preview video feed131 from a set of input video feeds 131. At the start 610, the touchscreen 110 includes 600 n video feed 131 windows F(k), k=1, . . . , n,each displaying a respective feed received through an associated videoinput port S_(v) (k) from a video source S(k); a Preview windowdisplaying the feed through video input port S_(v) (i); and a Programwindow displaying the feed through video input port S_(v) (j). Then atouch of the Preview window is sensed 620, followed by a touch 630 of avideo feed 131 window F(m). The controller 141 now causes 640 the videofeed 131 from S_(v) (m) to be displayed in the Preview window, and S_(v)(m) to be designated as the Preview input port. The process ends 699.Again, FIG. 10 shows an alternative implementation of thisfunctionality.

Transition of the Preview Feed to the Program Feed

FIG. 7 is a flowchart illustrating, in an embodiment of the invention,the use of touch screen video switching to promote the Preview videofeed 131 to the Program video feed 131. At the start 710, the touchscreen 110 includes 700 n video feed 131 windows F(k), k=1, . . . , n,each displaying a respective feed received through an associated videoinput port S_(v) (k) from a video source S(k); a Preview windowdisplaying the feed through video input port S_(v) (i); and a Programwindow displaying the feed through video input port S_(v) (j). Then atouch is sensed 720 by the controller 141 of the Program window, or someother touch, such as the press of a “Take” button, is sensed thatindicates a transition of the Preview feed to Program is desired. ThePreview feed is then transitioned 730 to Program, according to apreviously specified setting of transition type (e.g., crossfade orcut). The old Program feed becomes 740 the new Preview feed. The processends 799.

Controller Configuration Processor

FIG. 8 gives an overview of the structure of a controller 141 in anexemplary touch screen video production and control system 100. Undersupervision of a processor 200, the controller 141 providesfunctionality similar to that shown in FIG. 2.

The processor 200 interacts with users through the touch screen controlinterface 810 controls, such as window presses; take button; controlsfor transformation from Preview to Program; controls for cameraconfiguration; and other controls provided by the GUI 139. Some or allof the functionality provided by the touch screen 110 controls may beprovided through the control panel user interface 820. The touch screencontrol interface 810 communicates with the processor 200 using serialcommunications through a touch screen RS-232 level shifter 812 and atouch screen RS-232 connector 811.

This touch screen video production and control system 100 is designed toreceive input feeds from, and to control, up to six video sources 170,which are remote control or robotic cameras 171 in this particularembodiment. The controller 141 interacts with the cameras 171 throughcamera control ports 870, which are RS-232 connectors 871. Serialcommunication between the processor 200 and these ports uses a levelshifter 872 and a serial MUX 873.

The processor 200 communicates with the control panel 140 through thecontrol panel user interface 820 using serial communication for acontrol panel display 145; analog communication for a joystick 144 andfor rotary encoders 824, such as might receive input from a knob 146 ordial; and I2C bus communication via I2C multiplexer 860 to buttons 143and LEDs 147 on the control panel 140.

This touch screen video production and control system 100 provides anautomated control interface 840 with external sources, which can causethe controller 141 to perform operations similar to those that may berequested by a human user through the touch screen control interface 810or the control panel user interface 820. For example, when a speakersteps on a mat near a whiteboard, that may cause a trigger input 850 tothe controller 141; the controller 141 may be programmed to respond byconfiguring a particular camera 171 to focus on the speaker. Thisinterface might also be used, for example, to track a speaker as thespeaker moves around a stage. This kind of camera 171 control isdescribed in U.S. patent application Ser. No. 11/527,120. The automatedcontrol interface 840 might cause the controller 141 to perform any ofthe functions shown in FIG. 2, such as promoting a video feed fromPreview to Program.

The processor 200 also utilize hardware storage 801 as needed to storeinstructions and data. An external communication interface 802 isprovided to allow an external device to communicate data and software tothe controller 141, and to update firmware.

Video Content Control

The processor 200 exercises video content control 880 over the touchscreen 110 and the video Program output connection 152 using MUX SerialPeripheral Interface (SPI) 881 and Switcher SPI 882. FIG. 9 shows anexemplary implementation of a video content subsystem 900 in a touchscreen video production and control system 100 that has video switchingtechnology.

The video feeds 131 are received by the video content subsystem 900through video feed connections 150 a, implemented as analog signal 910via ports A1 901 a through A5 901 e and digital signal 914 via port D1901 f. The analog signals 910 and the digital signal 914 are convertedto a common format, here 8-bit color digital video (DV) 912, usinganalog decoders 911 and digital decoder 915. A touch screen layout FPGA920 controls how the decoders standardize each input feed signals usingI2C bus 913. The controller 141 uses I2C buses for control in a numberof contexts; a typical one is labeled I2C 935.

In other embodiments, a variety of source connections might beimplemented by plug-in devices (e.g., circuit cards) that do the bulk ofthe format standardization according to specifications from thecontroller 141.

The touch screen layout FPGA 920 operates under control of the processor200 via MUX SPI 881. The touch screen layout FPGA 920 arranges thedisplay of the touch screen 110 monitor or other visualization devicefrom the video feeds 131. It performs operations of multiplexing,scaling, arrangement of windows (such as video feed window 130,thumbnails 136, Program window 120, Preview window 122, and GUI 139) onthe screen, and formatting of the video content. In this embodiment, thetouch screen layout FPGA 920 creates the entire content of the touchscreen 110 one frame at a time, sending 933 the frames sequentially tointerlacing FPGA 940. The touch screen layout FPGA 920 uses frame buffer921 to ensure smooth sequencing of the input signal. The touch screenlayout FPGA 920 also controls formatting of the Program and touch screenoutput signals through I2C buses connected to Program output digitalencoder 951, Program output analog encoder 952, touch screen displaydigital (DVI-D) encoder 953, and touch screen display analog encoder954.

The interlacing FPGA 940 interlaces the output signals if appropriatefor the display, and communicates with the output encoders. The touchscreen 110 display signal, including the content of all the windows andGUI 139, is sent 943 as DV to touch screen display digital (DVI-D)encoder 953 where it is reformatted into output digital signal, hereDVI-D, and sent through touch screen digital output port 963 to thetouch screen 110 (if the touch screen 110 display is digital).Similarly, the touch screen 110 display signal is sent 944 as DV totouch screen display analog encoder 954 where it is reformatted intooutput analog (in this case, YPbPr or RGBHV) signal, and sent throughtouch screen analog output port 964 to the touch screen 110 (if thetouch screen 110 display is analog). Communication 180 betweencontroller 141 and touch screen 110 includes the display output throughtouch screen digital output port 963 or touch screen analog output port964, as well as control communication through touch screen RS-232connector 811.

The processor 200 controls video switcher 930 through Switcher SPI 882according to the then-current transition mode. The video switcher 930manages transitions of Preview feed 123 to Program feed 121. It receivesthose feeds as inputs 923 and 924, and produces a single Program outputsignal 931. It uses frame buffer 932 to ensure a smooth output signal.This signal is processed similarly to the signal 933 for the touchscreen 110 monitor, including signals 941 and 942, encoders 951 and 952,and digital 961 and analog 962 output ports. The Program video output199 is the output from ports 961 and 962.

Alternative Touch Screen Video Source Control and Switching Commands

FIG. 3-7 described in detail one set of touch screen 110 commands forvideo source control and video switching. In the table of FIG. 10, weillustrate another scheme, one of many possibilities approaches withinthe scope of the invention for providing such functionality to the touchscreen UI 111. The table has columns, corresponding to type 1000 oftouch screen video production and control system, initial state 1001 ofthe system 100 before the command; the response 1002 desired by the userwhen executing the command; the action 1003 performed by the user andsensed by the system; and the consequences 1004, direct and possiblysecondary. The type 1000 is either “SC”, indicating an operation thatwould be more likely to be supported in a system with video sourcecontrol; or “VS” indicating an operation that would be more likely to besupported in a system with video switching. All the operations would beappropriate for a system 100 with both video source control and videoswitching.

The table has five rows, representing a user operation through the touchscreen UI 111. Referring back to the touch screen 110 display of FIG. 1should be helpful in following the following discussion.

Operation 1020 is promoting a video feed 131 from Preview to Program. Weassume, for the sake of illustration, that Feed 2 is the current Programfeed 121 and Feed 4 is the current Preview feed 123. The system 100senses that the Preview window 122 has been pressed. The Program feed121 is transitioned, according to the transition method chosen by theuser, into Feed 2. Feed 2 is sent to Program video output 199 to Programconsumers 191. Feed 4 is transitioned according to the currenttransition mode into the new Preview feed.

As a result of the previous operation, Feed 4 is the Program feed andFeed 2 is Preview. Operation 1021 is promoting a video feed 131 (otherthan the Program feed), in this case Feed 1, to Preview. A press by theuser of feed window 1 is sensed. Feed 1 is displayed in the Previewwindow, and the set of preset configurations for Feed 1 are displayed asthumbnails. The preset currently selected for Feed 1 is emphasized.

After the previous operation, the user wants to change 1022 the videosource 170 for Feed 1 to a different preset configuration, namely 1E.The system 100 senses a user press of thumbnail 1E, and sends controldata 263 to the video source 170, which responds by changing to thecorresponding preset configuration. This modifies the view beingpresented by video in the Preview window. Thumbnail 1E is emphasized orhighlighted.

After the previous operation, the user decides to interactively modify1023 the configuration of the video source 170 for Feed 3 using controlsin the touch screen UI 111 or the control panel 140. The user pressesand holds the Feed 3 window for at least four seconds. Feed 3 ispromoted to Preview. An inset is shown in the Feed 3 window having thesame size as a thumbnail 136 to indicate that configuration is inprogress. The user can see the Feed 3 view from the video source 170 inthis inset. Pressing the Feed window again ends the reconfiguration, butnote that it does not save the new configuration as a preset. To do so1024, while the inset is still visible, the user can press one of thethumbnails for Feed 3. That thumbnail and corresponding preset will bereplaced by corresponding ones for the new configuration.

Separate Video Source Control System

FIG. 11 illustrates how the touch screen video source controlfunctionality of a touch screen video production and control system 100can be implemented as a video source control system 1100 separate fromthe touch screen video switching functionality. Such a video sourcecontrol system 1100 might nevertheless be combined in a singlesystem—possibly even housed within a single box—with components that dovideo switching using a method that does not have the innovative touchscreen video switching aspects described in this and related patentdocuments. Alternately, video switching might be performed by anentirely separate system, or not at all.

The video source control system 1100 includes video source configurationaspects of the combined system already described. Since most of theelements of these figures should be familiar to the reader from previousfigures, reference numbers, and associated text, we will concentrate onelements that are specific to a separate video source control system1100, as contrasted with the combined system illustrated by FIG. 1.

Like the combined system 100, the touch screen user interface 1111 ofvideo source control system 1100 has a set of video feed windows 130 anda set of thumbnails 136 for preset configurations 137. The functionalityof these windows is described in FIG. 3-5, and in FIG. 10 for operationsdesignated as type “SC”. The GUI 1170 will include controls relevant tovideo source control, for example, controls to change PTZ of a camera171, or to select a slide from a business presentation. The video sourcecontrol system 1100 has a controller 1141, and possibly a control panel1140. This control panel 1140 includes a joystick 144 for configurationof cameras 171.

Input to the video source control system 1100 is from video sources 1130a-1130 d. The number of video sources 170 can be arbitrarily large.Some, and perhaps all of these video sources 170 are likely to becapable of some kind of remote control or configuration. Consequently,communication systems 1135 are represented by two-way arrows. Eachcommunication system(s) 162 might be of any type, as described inreference to FIG. 1. The video input connections 1153 from the videosources 170 to the video source control system 1100 are shown as two-way(although not all need be), including both a video feed connection 150 aand a video source control connection 150 b.

The video feeds 131 output by the video source control system 1100 maybe manipulated on an ongoing basis by reconfiguration through the touchscreen UI 111 of the video sources 170. The illustrative video sourcecontrol system 1100 shows the same number of video output connections1152 as video feed connections 150 a. Because the video source controlsystem 1100 may play a filtering and selection role, the number of videooutput connections 1152 might in some embodiments be smaller than thenumber of video feed connections 150 a. In practice, the video feedsoutput from the system will be transmitted over some kind(s) ofcommunication system 1136 to video feed consumers 1131 a-1131 d.

In a combined system such as illustrated in some detail in FIGS. 1, 2, 8and 9, the video source interfaces 150 to the system 100, in effect,play the roles of both input connections video input connections 1153and consumers 1131 a-1131 d. In a combined system, separate video outputconnections 1152 from the video source control components of the systeminto the video switching components are not necessary. There is a singleset of inputs and a single set of outputs from the system.

The functionality of the controller 1141 in a video source controlsystem 1100 is illustrated by FIG. 12. This figure will not be describedin detail. The functional aspects of the controller 1141 are a subset ofthose previously detailed in reference to FIG. 2, and all referencenumbers in the figure have already been identified in the text.

The video switching components of FIG. 9, such as video switcher 930,are not necessary in a video source control system 1100. ReplacingProgram output encoders 951 and 952, and Program output connectors 961and 962. there will be corresponding components to implement videooutput connections 1152 for custom-configured video feeds 131.

CONCLUSION

Throughout this document, the word “or” should be interpreted as“inclusive or” unless otherwise clear from the context. Also, the word“each” is used in some of the claims. The reader should note that if Aincludes Bs, such that each B contains property P, then A might alsoinclude Bs that do not have property P.

Of course, many variations of the above method are possible within thescope of the invention. The present invention is, therefore, not limitedto all the above details, as modifications and variations may be madewithout departing from the intent or scope of the invention.Consequently, the invention should be limited only by the followingclaims and equivalent constructions.

1-13. (canceled)
 14. A method, comprising: a) storing a first set ofconfiguration pairs, each pair including an image and correspondingcontrol data; b) simultaneously displaying the images on a touch screen;and c) upon sensing a first touch event selecting an image in the set ofpairs, emphasizing the image and sending the control data correspondingto the image through a first video source control connection.
 15. Themethod of claim 14, further comprising: d) receiving a first video feedthrough a first video feed connection, wherein the first video sourcecontrol connection and the first video feed connection are included in afirst video source interface; and e) displaying the first video feed onthe touch screen simultaneously with the images.
 16. The method of claim15, wherein sending the control data through the video source controlconnection affects subsequent content of the first video feed.
 17. Themethod of claim 15, further comprising: f) storing a second set ofconfiguration pairs, each pair including an image and correspondingcontrol data; g) receiving a second video feed through a second videofeed connection that is contained in a second video source interface,the second video source interface including a second video sourcecontrol connection; h) displaying content of the second video feed onthe touch screen; and i) upon sensing a second touch event indicatingselection of the second video feed, simultaneously displaying the secondset of images on the touch screen.
 18. The method of claim 17, furthercomprising: j) upon sensing a third touch event, which selects an imagein the second set of configuration pairs, emphasizing the image andsending the control data corresponding to the image through the secondvideo source control connection. 19-22. (canceled)
 23. The method ofclaim 15, further comprising: c) receiving an indication through a userinterface, which includes the touch screen, that a first configurationpair, including a first image and first control data, is to be modified;d) sending a nonempty set of source control commands through the firstvideo source control connection; and e) after sending the set of sourcecontrol commands, receiving a second image and second control datathrough the first video source interface, and replacing, in the firstconfiguration pair, the first image and first control data with thesecond image and second control data, respectively.
 24. The method ofclaim 23, wherein the indication is received through the touch screen.25. The method of claim 23, wherein a source control command, in the setof source control commands, is determined by at least one user interfaceevent.
 26. The method of claim 23, wherein a source control command, inthe set of source control commands, is based upon a nonempty set of userinterface events.
 27. The method of claim 26, wherein the set of userinterface events includes a touch screen event.
 28. The method of claim26, wherein the set of user interface events includes a joystick event.29. The method of claim 23, wherein a source control command, in the setof source control commands, is a pan, tilt, or zoom command directed toa camera.
 30. The method of claim 23, further comprising: e) receiving avideo feed through the first video feed connection in a configurationthat corresponds to the second image.